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Convergence in Distribution 


7.2.4 Convergence in Distribution 

Convergence in distribution is in some sense the weakest type of convergence. All it says is that the CDF of X n 's converges to the 
CDF of X as n goes to infinity. It does not require any dependence between the X n ’s and X. We saw this type of convergence 
before when we discussed the central limit theorem. To say that X n converges in distribution to X, we write 

d 

x n -»■ x. 

Here is a formal definition of convergence in distribution: 

Convergence in Distribution 

A sequence of random variables X\, X2, X3, • ■ ■ converges in distribution to a random variable X, shown by X n 

lim F x „(x) = F x (x), 

n —>00 

for all x at which Fx ( X ) is continuous. 

Example 7.5 

d 

liXi, X2 , X3, • • • is a sequence of i.i.d. random variables with CDF Fx(x), then X n —> X. This is because 

Fx n (x) = F x (x), for all x. 

Therefore, 

lim F Xn (x) = F x (x), for all x. 

n—>00 



Example 7.6 

Let X2, X4, • • • be a sequence of random variable such that 


r 1-(1 -hr x>0 


Fx„(x) = < 


0 


otherwise 


Show that X n converges in distribution to Exponential( 1). 

• Solution 

o Let X ~ Exponential ( 1 ). For x < 0, we have 


For X > 0 , we have 


Fx n {x) = F x (x) = 0, forn = 2,3,4,- 


lim F x n (*) = lim 1-1- 

n 

= 1 - lim I 1 - - 

n ^>oo \ fl 


= l-e~ x 

= Fx(x), for all x. 


Thus, we conclude that X n —> X. 
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When working with integer-valued random variables, the following theorem is often useful. 


Theorem 7.1 Consider the sequence X\, X 2 , X 3 , ■ ■ ■ and the random variable X. Assume that X and X n (for all 71 ) are non¬ 
negative and integer-valued, i.e., 

Rx C {0, 1,2, • • •}, 

Rx„ c {0, 1 , 2 , • • •}, for n = 1 , 2 , 3, • • • . 


Then X n —7 X if and only if 


Proof 


lim P Xn {k) = P x (k), for k = 0,1, 2, - - - 


° Since X is integer-valued, its CDF, F x {x), is continuous at all a: £ M— {0,1,2,...}. If X n —> X , then 
lim F Xn (x) = F x (x), for all x £ R — {0,1,2,...}. 

n—> 00 71 

Thus, for k = 0,1, 2, • • ■, we have 


lim P Xn ( k) = lim 




(X n ’s are integer-valued) 


= lim F x (k H— ) — lim F x (k - 

n—>00 " \ 2 J n—>00 " ^ 2 

= F x (k + i J - F x (k - 0 (since X n 4 X) 

= P x {k ) (since X is integer-valued). 

To prove the converse, assume that we know 

lim P Xn (k) = P x (k), for k = 0,1,2, • • •. 

n—>00 

Then, for all X £ M, we have 

lim F Xn (x) = lim P{X n < x) 

n—>00 n—» 00 

[xj 


= lim ^ 2 P Xn (k), 


k =0 

where \x\ shows the largest integer less than or equal to X. Since for any fixed X, the set {0, 1, • • •, \x\ } is a finite 
set, we can change the order of the limit and the sum, so we obtain 

Lxj 

lim F Xn {x) = ^2 lim p x„( k ) 

n — >00 ‘ n—>00 

k =0 

[xj 

= ^2 P x ( k ) (by assumption) 

k =0 

= P(X < x) = F x (x). 


Example 7.7 

Let Xi, X 2 , X 3 , • • • be a sequence of random variable such that 
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. A . 

X n ~ Binomial ( n, — ) , for n € N, n > A, 
n 


where A > 0 is a constant. Show that X n converges in distribution to Poisson(X). 


Solution 

o By Theorem 7.1, it suffices to show that 


lim P Xn (k) = P x (k), for all k = 0,1,2, • • • 


We have 


, x /n\ / A \ V A x n ~ k 

Umr>x„M = (i-- 

= \ k lim - (A) (l - - 

n—>oo k\{ti — /cj! \n K J \ n 


n—k 


= A. lim 

k\ n—> oo 


n(n — l)(n — 2)... (n — k + 1) 




1 - 


A 

1 - 

n 


Note that for a fixed k, we have 


n(n — l)(n — 2)... (n — k + 1) ^ 


n"' 

lim I 1 - — | =1, 

n—»oo \ n 

lim I 1 - - ] = e“ A . 

n->oo \ 77 , 


Thus, we conclude 


lim PxS k ) = 


-x X k 

~ki~ 


We end this section by reminding you that the most famous example of convergence in distribution is the central limit theorem 
(CLT). The CLT states that the normalized average of i.i.d. random variables X\, X 2 , X 3 , ■ ■ ■ converges in distribution to a 
standard normal random variable. 

<— previous 
next —» 


https://www.probabilitycourse.com/chapter7/7_2_4_convergence_in_distribution.php 


3/3 



